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‘Implicit communication’ 










1. Decide upon the gestures which will control it 

2. Define the gesture capture strategies which work best 

3. Define the accompanying synthesis algorithms / music software 

4. Map the sensor outputs to the music control 

5. Decide on the feedback modalities available, 

apart from the sound itself (visual, tactile, kinaesthetic, etc.) 



New Digital Musical Instruments: Control and Interaction Beyond the Keyboard 

Miranda & Wanderley 




“An efficiency-focused approach to interaction may no longer 
suffice: it needs to be complemented by knowledge on the 
aesthetic aspects of the user experience” 


Easy doesn’t do it: skill and expression in tangible aesthetics 

Djajadiningrat, Matthews & Stienstra 


“A more holistic performance exploration of the parameter space” 






Radical User Interfaces for Real-Time Musical Control 

Hunt 




1. Convergent 


2. Divergent 
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Naturallv-mapped controls are laid-out: 

“...in a manner spatially analogous to the 
layout of the devices they control” 
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The Design of Future Things 

Norman 





1. Provide rich, complex, and natural signals 

2. Be predictable 

3. Provide a good conceptual model 

4. Make the output understandable 

5. Provide continual awareness, without annoyance 

6. Exploit natural mappings to make interaction understandable 







The Design of Future Things 

Norman 










Begins with... 


A careful look at the resources available 








A: Raw data 

B: Symbolic / semiotic data 
C: Gestural data 




A: Data 
B: Information 
C: Knowledge 





qirier 2006 








A: Raw data 

B: Symbolic / semiotic data 
C: Gestural data 






A mousepad is a two-dimensional surface 
with three degrees of freedom: X, Y, and 

QZ 

Motor Behaviour Models for Human-Computer Interaction 

MacKenzie 














Legend 
] Symbol keys 
] Executive keys 
] Modifier keys 



Motor Behaviour Models for Human-Computer Interaction 

MacKenzie 




























































































































Out of Range Tracking Dragging 



Motor Behaviour Models for Human-Computer Interaction 

MacKenzie 




Four-oscillator additive 
synthesizer, with 
distortion and 
low/band-pass filters. 
A drone/noise machine. 





(caution) 
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Csound implementation by Patrick McGlynn 

Original design by Casper Electronics 
www.casperelectronics .com 
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Group A: Raw data 


On/off 




Group B: Symbolic / semiotic 


Pitch/volume 



Group C: Gestural 


Distortion 


The potential for a musical performance system to engage, 
challenge and stimulate the user depends upon how their 
actions are interpreted by the system. 


Every performance action sends information into the system. 


It is critical that we grasp all possible ways to interpret this 




hanks for listening! 
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